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Abstract 

Background: Neurology is complex, abstract, and difficult for students to learn. However, a good learning method 
for neurology clerkship training is required to help students quickly develop strong clinical thinking as well as 
problem-solving skills. Both the traditional lecture-based learning (LBL) and the relatively new team-based learning 
(TBL) methods have inherent strengths and weaknesses when applied to neurology clerkship education. However, 
the strengths of each method may complement the weaknesses of the other. Combining TBL with LBL may produce 
better learning outcomes than TBL or LBL alone. We propose a hybrid method (TBL -i- LBL) and designed an experiment 
to compare the learning outcomes with those of pure LBL and pure TBL. 

Methods: One hundred twenty-seven fourth-year medical students attended a two-week neurology clerkship program 
organized by the Department of Neurology, Sun Yat-Sen Memorial Hospital. All of the students were from Grade 2007, 
Department of Clinical Medicine, Zhongshan School of Medicine, Sun Yat-Sen University. These students were assigned 
to one of three groups randomly: Group A (TBL-i- LBL, with 41 students). Group B (LBL, with 43 students), and Group C 
(TBL, with 43 students). The learning outcomes were evaluated by a questionnaire and two tests covering basic 
knowledge of neurology and clinical practice. 

Results: The practice test scores of Group A were similar to those of Group B, but significantly higher than those of 
Group C. The theoretical test scores and the total scores of Group A were significantly higher than those of Groups B 
and C. In addition, 100% of the students in Group A were satisfied with the combination of TBL + LBL. 

Conclusions: Our results support our proposal that the combination of TBL -i- LBL is acceptable to students and 
produces better learning outcomes than either method alone in neurology clerkships. In addition, the proposed 
hybrid method may also be suited for other medical clerkships that require students to absorb a large amount of 
abstract and complex course materials in a short period, such as pediatrics and internal medicine clerkships. 
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Background 

Students deal with a large number of diverse nervous 
system disorders in clinical situations and perceive neur- 
ology as being overly complex, abstract, and far more 
difficult than other disciplines [1-3]. At the same time, 
bridging medical theory and clinical practice, the clerk- 
ship is one of the crucial stages in neurology education; 



* Correspondence: docylh(a)l 63.com 
^Equal contributors 

'Department of Neurology, Sun Yat-Sen Memorial Hospital of Sun Yat-Sen 
University, No. 107, West Yanjiang Road, Guangzhou 510120, People's Republic of 
China 

Full list of author information is available at the end of the article 

(3 Bion/led Central 



it develops students' clinical reasoning and practical 
skills [4]. However, the traditional lecture-based learning 
(LBL) widely used in neurology clerkship education 
often leads to unsatisfactory learning outcomes because 
medical students passively receive knowledge from in- 
structors with little interaction, and lack motivation to 
study and innovate [5,6]. It is important to develop a 
practical and effective learning method for neurology 
clerkship education [7,8]. 

Team-based learning (TBL), as proposed by Michaelsen 
et al. [9] at the University of Oklahoma, is an instructional 
strategy that aims to improve students' teamwork spirit 
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and cooperation skills. TBL requires students to read the 
course materials and do preliminary homework prior to 
their class, and encourages them to work together effect- 
ively as a team to solve problems during the class. Before 
the recent introduction of TBL to medical education, it 
was implemented in other educational curricula for many 
years. TBL has been successfully used in the education of 
basic medical sciences such as physiology and anatomy 
[10-14], and was widely accepted by students [15,16]. Des- 
pite its success in teaching basic sciences, we feel that TBL 
has its drawbacks when applied to neurology clerkship 
education. TBL relies on students to prepare and do their 
homework by themselves, but the neurology course mate- 
rials are usually very difficult for them to understand, and 
it is even harder for students to build a clear and well- 
organized knowledge hierarchy. Meanwhile some research 
also found that TBL may benefit only students who are less 
able to learn and need to be helped by other team mem- 
bers [17,18], or only those with excellent innovative think- 
ing [19]. These drawbacks motivated us to explore a more 
effective method of neurology clerkship training. 

According to the literature and our experiences, LBL 
excels in breaking down difficult subjects by logically or- 
ganizing them in a clear hierarchy and presenting them 
systematically. Conversely, TBL excels in motivating stu- 
dents to learn proactively and promotes team collabor- 
ation. The strengths of each method may complement 
the weaknesses of the other. Combining TBL with LBL 
may produce better learning outcomes than TBL or LBL 
alone. 

In this study, we proposed a new hybrid LBL and TBL 
method (TBL + LBL) for neurology clerkship education. 
In addition, we designed an experiment to teach three 
groups of students with LBL, TBL, and TBL + LBL, re- 
spectively. We compared the theoretical and practice 
test scores of these three groups at the end of the experi- 
ment to evaluate the TBL + LBL learning outcomes. In 
addition, a questionnaire was completed by the students 
in the TBL and TBL + LBL groups to evaluate their 
satisfaction. 

Methods 

This study on neurology clerkship education was orga- 
nized by the Department of Neurology at Sun Yat-Sen 
Memorial Hospital in a five-year undergraduate program 
for students majoring in Clinical Medicine. The fourth 
year of the program is dedicated to clerkships in many 
medical specialties, including two weeks in neurology. 
The entire 127-student class of Grade 2007, Department 
of Clinical Medicine, Zhongshan School of Medicine, 
Sun Yat-Sen University (SYSU) participated in this neur- 
ology clerkship. 

Although the students were given the opportunity not to 
participate in this study, all students chose to participate. 



The students were randomly assigned to one of three 
groups by drawing lots: Group A (TBL + LBL, with 41 stu- 
dents including 22 men and 19 women). Group B (LBL, 
with 43 students including 23 men and 20 women), and 
Group C (TBL, with 43 students including 21 men and 22 
women). Before the clerkship started, all students had 
completed the related courses. No significant difference 
was observed between the three groups in terms of sex, 
age, and theoretical test score before the program. The 
program was organized into 2-week sessions for each 
group, which were held one after another in the order of 
Groups B, C, and A. Each group spent the same amount of 
time studying with the instructor. 

LBL method 

The curriculum consisted of many case studies that cov- 
ered several important neurology courses, such as Phys- 
ical Examination of Nervous System, Nervous System 
Qualitative and Positioning Diagnosis Principles, Princi- 
ples for Differential Diagnosis, Cranial Neuropathy and 
Peripheral Neuropathy, Cerebrovascular Diseases, Spinal 
Cord Diseases, and Peripheral Nervous System Diseases. 
For each type of case, all Group B students were led into 
a big room dedicated for teaching in the Department of 
Neurology of the hospital. The patients were temporarily 
moved to this room before the demonstration. The in- 
structor first demonstrated the process of medical his- 
tory inquiry and physical examination, and then 
provided the examination results to the students as a 
reference. After the demonstration, the instructor gave 
lectures to explain the clinical characteristics of the 
cases, the special examination methods for the cases, the 
key points of disease identification, diagnosis, and treat- 
ment, as well as the fundamental concepts for many 
common neurological diseases. These common neuro- 
logical diseases include cerebrovascular, spinal cord, and 
peripheral nervous system diseases. Subsequently, the 
students were required to identify the characteristics of 
each case and propose a diagnosis and treatment plan 
before the instructor summarized the case study and 
drew conclusions for the students. 

TBL method 

Group C participated in the second clerkship session. 
Compared with Group B, the instructor, the curriculum, 
the learning objectives, and the time spent with the in- 
structor were all the same. The only difference was in 
the learning methods. As for Group B, the instructor 
conducted a similar demonstration at the beginning of 
each case study. However, the groups diagnosed different 
patients because the majority of patients usually stayed 
for less than two weeks at the hospital and therefore it 
was difficult to use the same patients for case diagnosis 
in separate 2-week sessions. Nevertheless, we carefully 
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chose the patients for the same cases so that their dis- 
ease types, symptoms, and diagnosis results were similar, 
to minimize the difference in learning experiences. After 
the demonstration, instead of receiving lectures as 
Group B did, the students in Group C studied the same 
topics in a team-based way as described below. 

Group C were divided into seven teams with each 
comprising five to seven students. Following a process 
described previously [20], TBL was conducted in three 
phases. Phase One was a preparatory phase. The stu- 
dents first familiarized themselves with the course objec- 
tives, requirements, and the case information given by 
the instructor prior to the class. On this foundation, the 
students studied relevant materials using a range of re- 
sources including textbooks, libraries, and the Internet. 
Team members collaborated with each other, but they 
also focused on different aspects ranging from clinical 
characteristics, examinations, diagnosis to treatment, re- 
spectively. Phase Two was a readiness assurance process, 
including an individual readiness assessment test (iRAT) 
and a group readiness assessment test (gRAT). Both tests 
were closed-book. The iRAT contained 10 multiple-choice 
questions and required each student to give the answers 
within 20 minutes. The questions were pertinent to the 
case and focused on fundamental concepts, clinical char- 
acteristics, and examinations. The gRAT was performed 
after the patient had been admitted to the hospital and the 
detailed examination results had become available. It in- 
cluded 10 multiple-choice questions for the teams to an- 
swer within 30 minutes. The questions focused on disease 
identification, diagnosis, and treatment choice. At first 
only intrateam discussions were allowed, through which 
each team was required to obtain its own answers. Next, 
interteam discussions and debates were performed to 
identify a set of answers that all students accepted. After- 
wards, the instructor evaluated the discussions and the an- 
swers, and provided feedback accordingly to help the 
students achieve a clearer and more systematic under- 
standing of the required knowledge and skills. Phase Three 
was the application of course concepts. Considering that 
students had acquired the necessary knowledge and skills 
through phases One and Two, the instructor presented 
five to eight complex questions. The questions required 
students to summarize, analyze, and reason carefully based 
on the knowledge they had learnt and the cases they had 
observed. Similarly to the process in Phase Two, intrateam 
studies and discussions took place first. Afterwards, inter- 
team discussions and debates were performed between 
the teams holding different opinions. The instructor then 
commented on each team's discussion and summarized 
the main topics of the course. As the last step, the stu- 
dents were encouraged to evaluate each other based on 
their performance, in terms of motivation, analytical skills, 
and expression skills. 



TBL+ LBL method 

Both TBL and LBL were employed by Group A. During 
the first week. Group A received LBL, which covered 
complex and systematic courses such as Physical Exam- 
ination of Nervous System, Nervous System Qualitative 
and Positioning Diagnosis Principles, Principles for Dif- 
ferential Diagnosis, as well as Cranial Neuropathy and 
Peripheral Neuropathy. The procedure was similar to 
the one used for Group B. During the second week, TBL 
was employed for three common neurological courses: 
Cerebrovascular Diseases, Spinal Cord Diseases, and 
Peripheral Nervous System Diseases. The procedure 
was similar to the one used for Group C. Among the 
three groups, the curriculum, the instructor, the learning 
objectives, and the time spent with the instructor were all 
identical. 

Performance and satisfaction evaluation 

At the end of the clerkship, the performance of each stu- 
dent was evaluated with a theoretical test and a practice 
test. Well established in the medical program, the test 
content for the three groups was identical. The theoret- 
ical test mainly evaluated the students' understanding of 
the fundamental concepts, causes, characteristics, diag- 
nosis, and treatment for the diseases covered in the 
clerkship. The test questions were carefully selected 
from the standard question pool at SYSU. The scores of 
this test were not comparable with those of the preclerk- 
ship test because the two tests have different levels of 
difficulty. The practice test mainly evaluated the stu- 
dents' proficiency of conducting disease history inquiry, 
physical examination, and medical record writing. Each 
student was rated with a hundred-mark weighted total 
score, 40% of which was based on the practice test score 
and 60% was based on the theoretical test score. The 
weighting followed the teaching guidelines of SYSU and 
had been used consistently for many years. In addition 
to the tests. Groups A and C were required to complete 
a questionnaire to evaluate their satisfaction with TBL. 
The satisfaction was evaluated for various aspects in a 
four-point scale: excellent, good, fair, and poor. The an- 
swers were collected at the scene. 

Data analysis 

All analyses were conducted with SPSS software (version 
13.0; SPSS, Chicago, IL, USA). Enumeration data col- 
lected were analyzed using test. Measurement data 
were expressed as mean ± standard deviation, and f-test 
was conducted between the two groups. The level of sig- 
nificance was set at 0.05. 

Ethics approval 

The local Institutional Review Board at the Sun Yat-Sen 
Memorial Hospital of SYSU waived ethics approval 
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(application number: 20120928) for this research because 
the study protocol was not deemed to represent biomedical 
or epidemiological research and no personal data were 
used. The procedures complied with data-protection rules, 
and all data were anonymized prior to analysis. 

Results 

Base level of the students in the three groups 

The three groups consisted of only fourth-year students. 
As shown in Table 1, no significant difference was 
observed between the three groups in terms of student 
numbers, sex, age, and preclerkship theoretical test score. 

Comparison at the end of the clerkship 

Analysis of the test scores at the end of the clerkship is 
illustrated in Figures 1, 2, and 3. Group A achieved the 
highest scores. Groups A and B achieved similar practice 
test scores, but Group A achieved higher theoretical test 
and total scores {P < 0.05). Compared with Group C, 
Group A had higher scores in all aspects {P < 0.05). No 
significant difference between Groups B and C was ob- 
served in terms of theoretical test scores and total scores. 
However, Group C had much lower practice test scores 
than did Group B. 

Questionnaire 

The response rate to the questionnaire was 100%. The 
content of the questionnaire and the results are shown 
in Table 2. At least 85% of students had positive feed- 
back for TBL. They regarded TBL as an innovative 
learning method and agreed that it created an active 
classroom atmosphere in the neurology clerkship courses, 
enhanced learning motivation, strengthened teamwork 
spirit, and improved their ability to solve real clinical 
problems. In summary, TBL was highly accepted by 
the majority of students. Conversely, some students 
had negative feedback on TBL, which was mainly fo- 
cused on the fact that the teaching topics were less 
structured and less systematically organized, and thus 
it was more difficult for the students to gain a compre- 
hensive understanding of the subjects. The students 
agreed that LBL could help them learn the relatively 
complex and nonintuitive parts more easily than TBL. 
By contrast, TBL + LBL achieved 100% satisfaction, as 
shown in Table 2. 
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Figure 1 Comparison of the practice test scores at the end of the 
clerkship. The test scores of each group are represented by a thick 
solid line. The comparison between the test scores of every two groups 
is explained with a comment on a dotted line. In the comment for each 
solid line, Mean stands for the mean score of the corresponding group, 
while 5D stands for the standard deviation. Each solid line centers on 
Mean and stretches from (Mean - SD) to [Mean + SD). The longer the 
solid line is, the bigger the SD the corresponding test scores have. For 
each dotted line, its comment states the f-test result. If the result 
indicates significant difference (P < 0.05), the calculated effect size is also 
presented. The effect size can be either positive or negative. A positive 
effect size indicates positive difference in the direction of the arrow. 



Discussion 

In summary, our experiment led to three findings. First, 
the practice test scores of Group A (TBL + LBL) were 
similar to those of Group B (LBL), but significantly higher 
than those of Group C (TBL) were. In other words, the 
groups using LBL performed better in the practice test. 
Second, the theoretical test scores and the total scores of 
Group A were significantly higher than those of Groups B 
and C. Last, the questionnaire showed that the hybrid 
method was widely accepted by the students. 

Why did the two learning methods involving LBL lead 
to better practice test scores? The reason is twofold. 
First, LBL is suitable for neurology, which is known to 
be less accessible and user-friendly than other spe- 
cialties [2]. In LBL, lectures break down the difficult 
subjects of neurology into small topics, logically organize 
them in a relatively clear hierarchy, and present them 



Table 1 Baseline of the students in the three groups 



Group 


Number of students (n) 


Sex ratio (male/female) 


Age^ 


Theoretical test scores before the clerkship^ 


A (TBL + LBL) 


41 


22/19 


21.4±2.81» 


83.9 ±8.33* 


B (LBL) 


43 


23/20 


21.6 ±2.25 


84.2 ± 7.59 


CaBL) 


43 


21/22 


22.0 ± 1 .76 


84.7 ± 6.97 



*Compared with Groups B and C, P> 0.05, which means the differences between Group A and the other groups are insignificant. 
^Expressed as mean ± standard deviation. 
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Figure 2 Comparison of the theoretical test scores at the end 
of the clerkship. Please refer to the legends of Figure 1 for the 
meanings of solid lines, dotted lines, and their comments. 



systematically. This method is easier for students to 
memorize and understand the information presented. 
LBL also helps students connect and transform simple 
and abstract knowledge into a concrete, logical, and com- 
prehensive perspective. Second, LBL lays emphasis on 
developing fundamental clinical skills such as effective 
and accurate disease history inquiry, comprehensive ner- 
vous system examination, proper and formal medical rec- 
ord writing, as well as good communication between 
doctors and patients. These are all essential skills in clinical 
practice. Therefore, although TBL offers many advantages, 
traditional LBL is still indispensable for neurology clerkship 
education. Conversely, LBL also has disadvantages. For 
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Figure 3 Comparison of the total scores at the end of the 
clerkship. Please refer to the legends of Figure 1 for the meanings 
of solid lines, dotted lines, and their comments. 



Table 2 Questionnaire results from students in group A 
(TBL + LBL) and Group C (TBL) (number of responses (%)) 



Aspects 


Excellent 


Good 


Fair 


Poor 


Increasing motivation to prepare 
before class 


70 (83.3) 


7 (8.3) 


5 (6.0) 


2 (2.4) 


Increasing motivation and ability 
of thinking 


71 (84.5) 


7 (8.3) 


4 (4.8) 


2 (2.4) 


Activating class atmosphere 


79 (94.0) 


3 (3.6) 


2 (2.4) 


0(0) 


Promoting teamwork spirit and 
ability 


76 (90.5) 


5 (6.0) 


3 (3.5) 


0 (0) 


Developing clinical problem-solving 
skills 


66 (78.6) 


6(7.1) 


8 (9.5) 


4 (4.8) 


Improving the understanding of 
important and difficult topics 


60 (7T4) 


7 (8.3) 


8 (9.5) 


9 (10.7) 


Satisfaction with pure TBL 


67 (79.8) 


6(7.1) 


7 (8.3) 


4 (4.8) 


Satisfaction with TBL + LBL* 


36 (87.8) 


5 (12.2) 


0(0) 


0(0) 



*Only Group A was required to answer. 

instance, in our study we noticed that the students in 
the LBL groups tended to learn passively without proactive 
preparation before classes or review after classes. We also 
felt that they were less able to concentrate in the classroom 
and less motivated to take advantage of various learning re- 
sources. Other researchers have found that LBL is insuffi- 
cient for the absorption of the culture of clinical thinking 
[21] and teamwork spirit [9,11]. 

Combining LBL with TBL is an effective way to over- 
come these disadvantages of LBL. TBL stresses the en- 
couragement of students to learn proactively as well as 
to improve their analytical and problem-solving skills in 
clinical situations. Moreover, TBL is known to be benefi- 
cial for promoting teamwork and collaboration between 
students [9,14,20]. At the same time, TBL implicitly 
enhances the students' skills in bibliographic retrieval, 
logical reasoning, and oral presentation. These key abil- 
ities are extensively required in clinical practice, but 
often less practiced in LBL. The questionnaire results re- 
vealed that the majority of students accepted TBL and 
agreed that TBL could result in an active classroom at- 
mosphere, enhance their motivation to learn, strengthen 
teamwork spirit, as well as improve their clinical problem- 
solving skills. 

Furthermore, instructors can improve their teaching 
expertise during the TBL because successful TBL re- 
quires that they prepare questions with a certain level of 
difficulty related to the course content and the specific 
clinical diagnosis and treatment processes. This motivates 
the instructors to acquire not only the necessary solid 
knowledge and clinical skills, but also skUls in organizing 
and managing people. In addition, instructors may also be 
inspired by team discussions. In summary, TBL can be of 
value to both teachers and learners [22,23] . 

However, we observed several disadvantages of TBL 
that were also reported by others [24]. First, TBL is less 
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effective compared with LBL in students with weak self- 
directed study abilities. This ineffectiveness produces lar- 
ger variation in student learning outcomes. Second, for 
TBL to achieve better learning outcomes than LBL, stu- 
dents require a solid understanding of related neurology 
theories. Otherwise, it is very difficult for the students to 
understand abstract neurology concepts and engage in 
effective discussion. To support this finding, our results 
show that because the TBL groups did not receive as 
much systematic training in the classroom as the LBL 
groups did, they did not achieve significantly better 
scores than the LBL group (Figures 1, 2 and 3). Last, 
compared with LBL, TBL students often have less cap- 
ability to learn knowledge in a systematic way. The 
knowledge learnt with TBL tends to be not as deep or as 
comprehensive as with LBL. For instance, based on the 
feedback from the students in the TBL group, they 
tended to miss some important topics. 

Based on our experiences with TBL + LBL, we feel that 
the instructors play a very important role and they need 
to be trained specifically. This training has three goals: 
1) to design questions and cases closely related to the 
clinical practice, which should have clear emphasis and 
appropriate difficulty; 2) to facilitate learning by encour- 
aging students as well as providing ample practice op- 
portunities for them to develop clinical skills; 3) to 
summarize and conclude after each topic for students to 
gain complete and in-depth understanding of the know- 
ledge supplied. 

There were two limitations for this research. First, 
because no questionnaire was completed by the LBL 
groups, the authors do not know what the LBL groups 
thought of their learning experiences, so no comparisons 
can be made on student perspective. Though the results 
of the questionnaire indicated that Groups A and C had 
experienced increased motivation and teamwork spirit, 
the basis of comparison was their past LBL experiences 
in other subjects. Second, there may be a possibility of 
bias in student self-reports on the evaluation question- 
naire. To minimize this bias, the questionnaire was sent 
to the students only after the theoretical and the practice 
tests were completed. We will improve these in further 
research. 

Conclusions 

Our results support our proposal that combining TBL 
and LBL is acceptable to students and produces better 
outcomes for learning than either method alone in neur- 
ology clerkship education. In addition, the proposed 
hybrid method may also be suited for other medical 
clerkships that require students to learn large amount of 
abstract and complex course materials in a short period, 
such as clerkships in pediatrics or internal medicine. 
The processes for all types of clerkships are similar. LBL 



can be applied to the relatively complex and systematic 
courses while TBL can be applied to others. Moreover, 
the method can also be applied in other universities and 
countries. However, for optimal learning outcomes, the 
time and the courses assigned to each method should be 
carefully determined based on the course contents and 
students' characteristics. How to optimally design the 
courses based on these factors is a valuable research 
topic for further study. 
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